Image processing apparatus, image processing method and program

ABSTRACT

An image processing apparatus capable of performing chromatic aberration of magnification and noise reduction without decrease in processing performance and increase in the cost is provided. A format conversion circuit in the image processing apparatus converts first image data including an array of color components of red (R), green (G1 and G2), and blue (B) into second image data including the color components of R and B and a luminance component by performing false color suppression processing on the first image data separately using the color components of G1 and G2, and stores the data in an image buffer region. A circuit for correcting chromatic aberration of magnification reads the second data stored in the image buffer region and performs the correction of chromatic aberration of magnification.

BACKGROUND OF THE INVENTION

1. Field of the Invention

Embodiments of the present invention relate to a technique forcorrecting chromatic aberration of magnification on image data.

2. Description of the Related Art

Conventionally, techniques for correcting chromatic aberration ofmagnification caused by an imaging optical system have been known. Inthe technique discussed in Japanese Patent Application Laid-Open No.2008-015946, in order to correct chromatic aberration of magnification,first, a video signal captured by an image sensor including a colorfilter of a Bayer array is separated into red (R) components, green (G)components, and blue (B) components. Then, a pixel value of a pixel thatdoes not contain the R component is interpolated by adjacent pixels ofthe R components, so that an interpolation R component is generated. Apixel value of a pixel that does not contain the B component isinterpolated by adjacent pixels of the B components, so that aninterpolation B component is generated.

After the processing, a circuit for correcting chromatic aberration ofmagnification performs correcting chromatic aberration of magnificationby replacing each pixel value of the interpolation R components with apixel value expected to be there when the G components are used as areference. Further, if the position of the pixel to be replaced with thepixel value expected to be there is deviated by less than one pixel fromthe pixel values of the peripheral R components, by interpolating thedeviation of less than one pixel from the pixel values of the peripheralR components, the pixel value to be replaced is calculated. On theinterpolation of B components, similar replacement is performed.Further, the pixel positions of the interpolation R components and theinterpolation B components are corrected with respect to the Gcomponents, so that the chromatic aberration of magnification iscorrected.

The R components, B components, and G components whose chromaticaberrations of magnification are corrected are then subjected to imagequality adjustment processing, such as gamma correction and aperturecorrection, and the components are converted into luminance componentsand color difference components. When the color difference componentsare generated, false color suppression processing is performed such thataliasing around the Nyquist frequency does not appear as a false signalin the image.

Meanwhile, a technique for reducing noise by dividing an image signalinto a plurality of frequency bands and performing frequency synthesison the image signals processed in each frequency band has been known.For example, in the technique discussed in Japanese Patent ApplicationLaid-Open No. 2008-015741, while preserving edge components in each of nfrequency bands, noise components are reduced, so that only the noisecomponents may be reduced while the wide band edge components are beingpreserved.

By applying the above-described techniques, it is assumed that the imagequality adjustment processing, such as the gamma correction and theaperture correction, is performed by performing the correction ofchromatic aberration of magnification, and then the luminance componentsand the color difference components are output by performing the noisereduction processing while performing the false suppression processing.

However, in such a technique on the above-described assumption, theband-limited image signals need to be stored in many planes in a memoryincluding a dynamic random access memory (DRAM), or the like. Further,the image signals of each plane need to be stored for each frequencycomponent. Therefore, in a case of processing requiring high-speedperformance, such as continuous shooting, if a memory access amount perunit time increases and reaches an upper limit of the memory accessband, the processing performance decreases. Further, the increase in thenecessary memory capacity will cause increase in the cost of the imageprocessing apparatus.

SUMMARY OF THE INVENTION

One disclosed aspect of the embodiments is directed to an imageprocessing apparatus capable of performing correction of chromaticaberration of magnification and noise reduction without causingdeterioration of processing performance and increase in the cost.

According to an aspect of the embodiments, an image processing apparatusincluding a first conversion unit configured to convert first image dataincluding an array of color components of red (R), green (G1 and G2),and blue (B) into second image data including the color components of Rand B and a luminance component by performing false color suppressionprocessing on the first image data separately using the color componentsof G1 and G2, a first storage unit configured to store the second imagedata in a storage medium, and a correction unit configured to read thesecond image data stored in the storage medium and perform correction ofchromatic aberration of magnification on the color components of R and Bin the second image data.

Further features and aspects of the embodiments will become apparentfrom the following detailed description of exemplary embodiments withreference to the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate exemplary embodiments, features,and aspects of the invention and, together with the description, serveto explain the principles of the invention.

FIG. 1 illustrates a configuration of an image processing apparatusaccording to an exemplary embodiment.

FIG. 2 illustrates a configuration of a color filter of a Bayer array.

FIG. 3 illustrates a detailed configuration of a signal processingcircuit according to a first exemplary embodiment.

FIG. 4 illustrates a detailed configuration of an R thinning circuit.

FIG. 5 is a flowchart illustrating selection processing of a thinningmethod in RB thinning circuits.

FIG. 6 illustrates a detailed configuration of a signal processingcircuit according to a second exemplary embodiment.

FIG. 7 illustrates a detailed configuration of a signal processingcircuit in a comparative example.

FIG. 8 is a flowchart illustrating processing in a system controlcircuit according to a third exemplary embodiment.

DESCRIPTION OF THE EMBODIMENTS

Various exemplary embodiments, features, and aspects of the embodimentswill be described in detail below with reference to the drawings. Onedisclosed feature of the embodiments may be described as a process whichis usually depicted as a flowchart, a flow diagram, a timing diagram, astructure diagram, or a block diagram. Although a flowchart or a timingdiagram may describe the operations or events as a sequential process,the operations may be performed, or the events may occur, in parallel orconcurrently. In addition, the order of the operations or events may bere-arranged. A process is terminated when its operations are completed.A process may correspond to a method, a program, a procedure, a methodof manufacturing or fabrication, a sequence of operations performed byan apparatus, a machine, or a logic circuit, etc.

A first exemplary embodiment is described. FIG. 1 illustrates aconfiguration of an image processing apparatus according to the firstexemplary embodiment. In FIG. 1, an imaging optical system 101 whichincludes a lens, a diaphragm, and the like, performs focus adjustmentand exposure adjustment. An image sensor 102 includes a charge coupleddevice (CCD) sensor or a complementary metal-oxide semiconductor (CMOS)sensor. The image sensor 102 converts an optical image transmittedthrough the imaging optical system 101 into an electronic signal. Ananalog-to-digital (A/D) conversion circuit 103 converts an analog imagesignal output from the image sensor 102 into a digital image signal.

A signal processing circuit 104 performs processing, such as aberrationcorrection of the imaging optical system, noise reduction, or the like,to image data (digital image signal) output from the A/D conversioncircuit 103. A memory control circuit 105 writes and reads the imagedata to/from a memory (DRAM) 106. A system control circuit 107 controlsan entire operation of the image processing apparatus.

On an image forming plane of the image sensor 102, a color filter of aBayer array as illustrated in FIG. 2 is arranged for each pixel. Each ofthe pixels outputs a pixel value corresponding to the color of the colorfilter. In FIG. 2, a G filter located in the horizontal direction of anR filter and in the vertical direction of a B filter is defined as a G1filter, and a G filter located in the vertical direction of the R filterand in the horizontal direction of the B filter is defined as a G2filter.

FIG. 3 illustrates a detailed configuration of the signal processingcircuit 104 according to the first exemplary embodiment. In FIG. 3, thesignal processing circuit 104 includes a frequency decomposition circuit201, a frequency synthesis circuit 202, and an image buffer region 220.Image data output from the frequency decomposition circuit 201 is storedin the image buffer region 220. The frequency synthesis circuit 202reads the image data from the image buffer region 220, and performprocessing. The image data output from the frequency synthesis circuit202 is stored in the memory 106.

The frequency decomposition circuit 201 receives A/D-converted imagedata (first image data) as input. The image buffer region 220 serves asa buffer region to be used by the signal processing circuit 104. Aregion secured in the memory 106 in FIG. 1 may be used as the imagebuffer region 220. Low-pass filter circuits (LPFs) 203 to 205 removehigh-frequency components in the input image data. Down-samplingcircuits 206 to 208 reduce the image data output from the respectivelow-pass filter circuits 203 to 205.

Format conversion circuits 209 to 211 convert image data of R/G1/G2/B(i.e., R component, G1 component, G2 component, and B component) intoimage data (second image data) of Y/R/B (i.e., Y component, R component,and B component). Further, the format conversion circuits 209 to 211perform false color suppression processing.

The false color suppression processing may be implemented, for example,by the following method. According to correlation of a spatial directionof an optical image formed on the image sensor 102, a component havinghigher correlation is selected and defined as a (R-Ga1) component fromamong (R-G1) components or (R-G2) components in each pixel. Further, theG1 component and the G2 component are defined as the same G components.In each pixel, a Gb component is generated by interpolating the Gcomponents, and a (R-Gb) component is generated. Further, according tocolor saturation, the (R-Ga1) component or the (R-Gb) component isselected in each pixel and defined as a Cr component. A Cb component issimilarly generated.

By the above processing, the Cr component and the Cb component that arecolor difference signals in which the false colors are suppressed aregenerated in each pixel. The Cr component and the Cb component may bevalues obtained by performing weighted addition to the (R-Ga1) componentand the (R−Gb) component, or the value of the (R-Ga1) component may bedirectly used. A Y component that is a luminance signal is generated,for example, by the following calculation using the R component, the Gcomponent, and the B component interpolated according to the correlationin the special direction of the optical image formed on the image sensor102.

Y=0.30R+0.59G+0.11B

The format conversion circuits 209 to 211 generate Y as the Y component,(Cr+Y) as the R component, and (Cb+Y) as the B component based on the Ycomponent as the luminance signal, and the Cr component and the Cbcomponent that are the color difference signals, and output image dataof Y/R/B.

RB thinning circuits (i.e., an R thinning circuit+a B thinning circuit)212 to 214 reduce RB resolutions. FIG. 4 illustrates a detailedconfiguration of the R thinning circuit. A low-pass filter circuit 401may be implemented, for example, by a transfer function H(z)=½ (1+z⁻¹).A selector circuit 402 selects whether to use the low-pass filtercircuit 401. The system control circuit 107 selects an even phase or anodd phase as a phase for thinning. A horizontal direction thinningcircuit 403 performs thinning processing to the image data of the Rcomponents using the selected thinning phase. The B thinning circuit hasa configuration similar to the R thinning circuit. As will be describedbelow, the system control circuit 107 selects whether to use thelow-pass filter circuit 401 for each frequency band.

As a result, the frequency decomposition circuit 201 outputs image dataof Y/RB containing two planes of the Y components and the RB components,which are subjected to band limitation in each frequency band (Y/RB-2 toY/RB-4), to the image buffer region 220. The image data, which is notsubjected to the band limitation, is directly output as the image data(Bayer-1) of the Bayer array.

The frequency synthesis circuit 202 performs correction of chromaticaberration of magnification by circuits 215 to 218 for correcting thechromatic aberration of magnification in each frequency band. Withrespect to the data of Bayer-1, the circuit 215 for correcting thechromatic aberration of magnification performs R interpolation and Binterpolation, and further performs the correction of the chromaticaberration of magnification. With respect to the data pieces of Y/RB-2to Y/RB-4, as illustrated in FIG. 4, the circuits 216 to 218 forcorrecting the chromatic aberration of magnification select phases forthe interpolation according to the phases for the thinning selected inthe RB thinning circuits 212 to 214. More specifically, if the thinningphase is an even phase, an even phase is selected as the interpolationphase, and if the thinning phase is an odd phase, an odd phase isselected as the interpolation phase. With respect to the data pieces ofY/RB-2 to Y/RB-4, the circuits 216 to 218 for correcting the chromaticaberration of magnification perform the correction of the chromaticaberration of magnification of the R components and the B componentsusing the Y components as a reference instead of the G components.

In the R interpolation and the B interpolation, in the present exemplaryembodiment, the pixel values for interpolating the R components and theB components are generated using average values of peripheral pixels.However, the pixel values may be generated using other known techniques.For example, a technique for increasing resolutions of the R componentand the B component using a high-frequency component of the G componenthas been known. If this technique is applied by replacing the Gcomponent with the Y component, even if the horizontal resolutions ofthe R component and the B component decrease as a result of the RBthinning, the deterioration in the resolutions may be restored in thecorrection of the chromatic aberration of magnification. Further, alsoto the data of Bayer-1, the R interpolation and the B interpolation maybe applied by this technique.

For the correction of the chromatic aberration of magnification, a knowntechnique may be applied. For example, in a memory (not shown) forstoring correction data, a deviation of an image formation position ofthe R component to the image formation position of the Y component (orthe G component) is stored for each state of the imaging optical system101 (a zoom position, a focus position, an aperture value, or the like)and an image height. The circuits 215 to 218 for correcting thechromatic aberration of magnification read the deviation amount of theimage formation position of the R component in the target pixelcorresponding to the state of the imaging optical system 101 at the timethe video signal is generated by the image sensor 102 and the imageheight of the target pixel to be corrected. The circuits 215 to 218 forcorrecting the chromatic aberration of magnification calculate the valueof the R component at the position corresponding to the deviation amountby interpolation using values of R components of peripheral pixels ofthe position, and determine the obtained value as the value of the Rcomponent in the target pixel. The operation is similarly performed inthe B component.

A noise reduction circuit 219 generates the Cr component by (R-Y) usinginverse conversion by the format conversion circuits 209 to 211. Thenoise reduction circuit 219 similarly generates the Cb component by(B-Y). The processing of the noise reduction is separately performed tothe luminance component and the color difference component. In eachpixel and in each Y/Cr/Cb component, the Y/Cr/Cb component of onefrequency band is selected from among the Y/Cr/Cb components in thefrequency bands to which the noise reduction is performed, according toedge information of the object or the like, and output as an outputimage.

FIG. 5 is a flowchart illustrating the selection processing in thethinning method in the RB interpolation circuits 212 to 214. Inoperation S101, the system control circuit 107 selects whether to usethe low-pass filter circuit 401 in the RB thinning circuits 212 to 214.In operation S102, the system control circuit 107 selects individualthinning phases in the RB thinning circuits 212 to 214. In operationS103, the system control circuit 107 selects phases of the Rinterpolation and the B interpolation in the circuits 216 to 218 forcorrecting the chromatic aberration of magnification according to thethinning phases selected in operation S102.

As described above, the R component and the B component are necessary toperform the correction of the chromatic aberration of magnification, andthe G1 component and the G2 component are necessary to be separatelyused to perform the false color suppression processing. Therefore, theimage processing apparatus according to the present exemplary embodimentfirst performs the false color suppression processing in which the G1component and the G2 component need to be separately used, converts theimage data of R/G1/G2/B into the image data of Y/R/B, and stores theconverted data in the image buffer region 220.

Accordingly, the memory capacity of the image buffer region 220 may bereduced as compared to the case that the image data pieces decomposedinto the plurality of frequency bands are used as the image data ofR/G1/G2/B. The reason that not the image data of Y/Cr/Cb but the imagedata of Y/R/B is used as the image data to be stored in the image bufferregion 220 is that the correction of chromatic aberration ofmagnification using the R component and the B component is to beperformed in the latter stage.

Further, according to the present exemplary embodiment, by using the RBthinning circuits 212 to 214, the memory capacity necessary in the imagebuffer region 220 may be further reduced.

A second exemplary embodiment is described. The configuration of animage processing apparatus according to the present exemplary embodimentis similar to that illustrated in FIG. 1. However, in the presentexemplary embodiment, a detailed configuration of the signal processingcircuit 104 is different from that in the first exemplary embodiment.

FIG. 6 illustrates the detailed configuration of the signal processingcircuit 104 according to the second exemplary embodiment. In FIG. 6, aconfiguration of a frequency synthesis circuit 302 is similar to that ofthe frequency synthesis circuit 202 in FIG. 3. A configuration of animage buffer region 318 in FIG. 6 is similar to that in the image bufferregion 220 in FIG. 3. A configuration of a frequency decompositioncircuit 301 in FIG. 6 is partly different from that of the frequencydecomposition circuit 201 in FIG. 3.

A configuration of a low-pass filter circuit 303 is similar to those inthe low-pass filter circuits 203 to 205 in FIG. 3. A configuration of adown-sampling circuit 306 is similar to those in the down-samplingcircuits 206 to 208 in FIG. 3. A format conversion circuit 309 issimilar to the format conversion circuits 209 to 211 in FIG. 3. Asillustrated in FIG. 3, the three format conversion circuits arenecessary in the first exemplary embodiment. However, in the secondexemplary embodiment, only one format conversion circuit is necessary asillustrated in FIG. 6, and accordingly, the size of the circuit may besmall.

Low-pass filter circuits 304 and 305 are similar to the low-pass filtercircuit 303. A format of image data handled in the low-pass filtercircuit 303 is four planes of R/G1/G2/B. By comparison, a format ofimage data handled in the low-pass filter circuits 304 and 305 is threeplanes of Y/R/B, so that the size of the circuit may be small.

Similarly, down-sampling circuits 307 and 308 are similar to thedown-sampling circuit 306. However, the down-sampling circuits 307 and308 handle three planes, which is different from the down-samplingcircuit 306 handling four planes. As a result, the size of thedown-sampling circuits 307 and 308 may be small. RB thinning circuits310 to 312 are similar to the RB thinning circuits 212 to 214 in FIG. 3.In the present exemplary embodiment, the RB thinning circuits 310 to 312are provided for each frequency band, filtering or a thinning phase ofthe R component and the B component may be selected for each frequencyband as similarly to the case in FIG. 3.

A comparative example of the first and second exemplary embodiments isdescribed. A configuration of an image processing apparatus according tothe comparative example is similar to that illustrated in FIG. 1,however, a detailed configuration of the signal processing circuit 104is different from that in the first exemplary embodiment.

FIG. 7 illustrates the detailed configuration of the signal processingcircuit 104 in the image forming apparatus according to the comparativeexample. The signal processing circuit 104 includes a frequencydecomposition circuit 2001, a frequency synthesis circuit 2002, and animage buffer region 2014.

Low-pass filter circuits 2003 to 2005 in the frequency decompositioncircuit 2001 may be implemented, for example, by the transfer functionH(z)=½ (1+z⁻¹) both in the horizontal direction and the verticaldirection. Down-sampling circuits 2006 to 2008 may reduce image data inthe horizontal direction and the vertical direction. A phase to whichdown-sampling is performed is a pixel on the left side in two pixels ofright and left in the horizontal direction, and a pixel on the upperside in two pixels of the upper side and the lower side in the verticaldirection.

The image buffer region 2014 includes a DRAM or the like. The frequencydecomposition circuit 2001 receives image data of a Bayer array asinput. The frequency decomposition circuit 2001 outputs image data(Bayer-1), which is not subjected to band limitation, and image data(R/G1/G2/B-2 to R/G1/G2/B-4) of red components, green components, andblue components, which are subjected to the band limitation, as a thirdimage data to the image buffer region 2014.

The frequency band of the image data of R/G1/G2/B-2 is limited to halfin the horizontal direction and in the vertical direction by thelow-pass filter circuit 2003, and the pixel numbers are thinned to halfin the horizontal direction and in the vertical direction by thedown-sampling circuit 2006. The image data to be input has a Bayerarray, and each color filter component of R, G1, G2, and B has a halfresolution from the beginning in the horizontal direction and thevertical direction. Accordingly, the image data after the down-samplingprocessing is stored in each plane of the R component, the G1 component,the G2 component, and the B component.

The frequency band of the image data of R/G1/G2/B-3 is limited to halfin the horizontal direction and in the vertical direction by thelow-pass filter circuit 2004, and the pixel numbers are thinned to halfin the horizontal direction and in the vertical direction by thedown-sampling circuit 2007.

The frequency band of the image data of R/G1/G2/B-4 is limited to halfin the horizontal direction and in the vertical direction by thelow-pass filter circuit 2005, and the pixel numbers are thinned to halfin the horizontal direction and in the vertical direction by thedown-sampling circuit 2008.

The frequency synthesis circuit 2002 includes circuits 2009 to 2012 forcorrecting the chromatic aberration of magnification and a false colorsuppression and noise reduction circuit 2013. The frequency synthesiscircuit 2002 performs the correction of chromatic aberration ofmagnification in each frequency band by the circuits 2009 to 2012 forcorrecting the chromatic aberration of magnification. On the data ofBayer-1, the circuit 2009 for correcting the chromatic aberration ofmagnification performs R interpolation and B interpolation, and furtherperforms the correction of the chromatic aberration of magnification. Onthe data pieces of R/G1/G2/B-2 to R/G1/G2/B-4, the synchronization ofthe R component and the B component has already been performed, andaccordingly, the R interpolation processing and the B interpolationprocessing are skipped. In the following false color suppressionprocessing, difference information of G1 and G2 components is necessary,and therefore, the G component is output as the G1 component and the G2component to the false color suppression and noise reduction circuit2013.

The false color suppression and noise reduction circuit 2013 performsthe false color suppression processing of the color differencecomponent. In the processing, a color component is generated in eachfrequency component. At this step, an edge component is detected in eachfrequency component, and noise reduction processing is performed. Thegenerated components of each color are synthesized later, and output ascolor difference signals of a Cr component and a Cb component. Theresolutions of the color difference signals of the Cr component and theCb component in the horizontal direction are reduced to half of theresolutions respectively, and the signals are output as a colordifference signal CrCb of one plane. Regarding a luminance component,the noise reduction processing is performed according to a methoddiscussed in Japanese Patent Application Laid-Open No. 2008-015741, andthe signal is output as a luminance signal Y of one plane.

In the image processing apparatus according to the comparative example,it is necessary to store the image data, which is subjected to the bandlimitation, in the four planes of R/G1/G2/B in the image buffer region2014 including the DRAM, or the like. Further, it is necessary to storethe image data pieces of the four planes in each frequency band.Therefore, in a case of processing requiring high-speed performance,such as continuous shooting, if the memory access amount per unit timeincreases and reaches an upper limit of the memory access band, theprocessing performance decreases. Further, the increase in the necessarymemory capacity will cause increase in the cost of the image processingapparatus.

In comparison with the comparative example, in the first and secondexemplary embodiments, the image data of Y/RB comprising the two planesof the Y component and the RB component is output to the image bufferregion. Accordingly, the necessary memory capacity may be reduced, andthe cost may also be reduced. Further, the memory access amount per unittime may also be reduced, and accordingly, the processing performancemay be prevented from deteriorating.

As described above, according to the first and second exemplaryembodiments, the correction processing of chromatic aberration ofmagnification and the noise reduction processing may be performedwithout decrease in the processing performance and increase in the cost.Especially, according to the second exemplary embodiment, the processingmay be implemented by the small-sized circuit.

A third exemplary embodiment is described. The configuration of an imageprocessing apparatus according to the present exemplary embodiment issimilar to that illustrated in FIG. 1. However in the present exemplaryembodiment, a detailed configuration of the signal processing circuit104 is different from that in the first exemplary embodiment.

The signal processing circuit 104 in the present exemplary embodimentincludes an operation mode of the signal processing circuit 104 in thefirst or the second exemplary embodiment, and an operation mode of thesignal processing circuit 104 in the comparative example. The systemcontrol circuit 107 may switch the two operation modes by determining anecessary memory band.

As described above, according to the first or second exemplaryembodiment, the correction processing of chromatic aberration ofmagnification and the noise reduction processing may be performedwithout decrease in the processing performance and increase in the cost(i.e., a high performance mode). According to the comparative example,since the color component resolution is not reduced in the image bufferregion, higher quality image data may be generated (i.e., a high imagequality mode).

In the following description, a case where the performance is decreasedby limitation of a memory band, for example, a case where still imagesof about ten million pixels are captured at ten frames per second in ahigh-speed continuous shooting is used as an example. However, theembodiments are not limited to such case. For example, ifhigh-definition moving image recording and the other processing aresimultaneously performed, or an available memory band is limited due tothe other factors, the embodiments may be applied to the cases.

FIG. 8 is a flowchart illustrating processing in the system controlcircuit 107 according to the third exemplary embodiment. In operationS201, the system control circuit 107 determines whether the mode is ahigh-speed continuous shooting mode. If the mode is the high-speedcontinuous shooting mode (YES in operation S201), then in operationS202, the system control circuit 107 selects the high performance modeand ensures a necessary performance, for example, ten frames per second.On the other hand, if the mode is not the high-speed continuous shootingmode (NO in operation S201), then in operation S203, the system controlcircuit 107 selects the high image quality mode.

According to the present exemplary embodiment, when the correctionprocessing of the chromatic aberration of magnification and the noisereduction processing are performed, the operation mode may be selectedsuch that the image quality and the performance are to be optimum.

The embodiments may also be realized by executing the followingprocessing. More specifically, software (a program) for realizing thefunctions of the above described exemplary embodiments is supplied to asystem or an apparatus via a network or various storage media and acomputer (or a CPU or a micro processing unit (MPU)) of the system orthe apparatus reads and executes the program.

Further, the present exemplary embodiment may also be realized bysupplying software (e.g., a program or a set of instructions) forrealizing the functions of the above exemplary embodiments to a systemor an apparatus via a network or via various storage media, and having acomputer (a central processing unit (CPU) or a micro processing unit(MPU)) of the system or apparatus read and execute the program or theinstructions recorded/stored on an article of manufacture having amemory device or a non-transitory storage medium to perform operationsor functions of the above-described embodiments. In this case, thisprogram and the recording medium on which the program is recorded/storedconstitute one disclosed aspect of the embodiments. In addition, theprogram may be executed by one computer, or by a plurality of computerslinked together.

Disclosed aspects of the embodiments may be realized by an apparatus, amachine, a method, a process, or an article of manufacture that includesa non-transitory storage medium having a program or instructions that,when executed by a machine or a processor, cause the machine orprocessor to perform operations as described above. The method may be acomputerized method to perform the operations with the use of acomputer, a machine, a processor, or a programmable device. Theoperations in the method involve physical objects or entitiesrepresenting a machine or a particular apparatus (e.g., a storagemedium, an array of color components). In addition, the operations inthe method transform the elements or parts from one state to anotherstate. The transformation is particularized and focused on processing animage. The transformation provides a different function or use such asconverting first image data including an array of color components intosecond image data, storing the second image data in a storage medium,and reading the second image data and performing correction of chromaticaberration of magnification, etc.

In addition, elements of one embodiment may be implemented by hardware,firmware, software or any combination thereof. The term hardwaregenerally refers to an element having a physical structure such aselectronic, electromagnetic, optical, electro-optical, mechanical,electro-mechanical parts, etc. A hardware implementation may includeanalog or digital circuits, devices, processors, applications specificintegrated circuits (ASICs), programmable logic devices (PLDs), fieldprogrammable gate arrays (FPGAs), or any optical, electromechanical,electromagnetic, or electronic devices. The term software generallyrefers to a logical structure, a method, a procedure, a program, aroutine, a process, an algorithm, a formula, a function, an expression,etc. A software implementation typically includes realizing the aboveelements (e.g., logical structure, method, procedure, program) asinstruction codes and/or data elements embedded in one or more storagedevices and executable and/or accessible by a processor, a CPU/MPU, or aprogrammable device as discussed above. The term firmware generallyrefers to a logical structure, a method, a procedure, a program, aroutine, a process, an algorithm, a formula, a function, an expression,etc., that is implemented or embodied in a hardware structure (e.g.,flash memory). Examples of firmware may include microcode, writablecontrol store, micro-programmed structure. When implemented in softwareor firmware, the elements of an embodiment may be the code segments toperform the necessary tasks. The software/firmware may include theactual code to carry out the operations described in one embodiment, orcode that emulates or simulates the operations.

All or part of an embodiment may be implemented by various meansdepending on applications according to particular features, functions.These means may include hardware, software, or firmware, or anycombination thereof. A hardware, software, or firmware element may haveseveral modules or units coupled to one another. A hardware module/unitis coupled to another module/unit by mechanical, electrical, optical,electromagnetic or any physical connections. A software module/unit iscoupled to another module by a function, procedure, method, subprogram,or subroutine call, a jump, a link, a parameter, variable, and argumentpassing, a function return, etc. A software module/unit is coupled toanother module/unit to receive variables, parameters, arguments,pointers, etc. and/or to generate or pass results, updated variables,pointers, etc. A firmware module/unit is coupled to another module/unitby any combination of hardware and software coupling methods above. Ahardware, software, or firmware module/unit may be coupled to any one ofanother hardware, software, or firmware module/unit. A module/unit mayalso be a software driver or interface to interact with the operatingsystem running on the platform. A module/unit may also be a hardwaredriver to configure, set up, initialize, send and receive data to andfrom a hardware device. An apparatus may include any combination ofhardware, software, and firmware modules/units.

While the embodiments have been described with reference to exemplaryembodiments, it is to be understood that the embodiments are not limitedto the disclosed exemplary embodiments. The scope of the followingclaims is to be accorded the broadest interpretation so as to encompassall modifications, equivalent structures, and functions.

This application claims priority from Japanese Patent Applications No.2010-279543 filed Dec. 15, 2010 and No. 2010-279544 filed Dec. 15, 2010,which are hereby incorporated by reference herein in their entirety.

1. An image processing apparatus comprising: a first conversion unitconfigured to convert first image data including an array of colorcomponents of red (R), green (G1 and G2), and blue (B) into second imagedata including the color components of R and B and a luminance componentby performing false color suppression processing on the first image dataseparately using the color components of G1 and G2 ; a first storageunit configured to store the second image data in a storage medium; anda correction unit configured to read the second image data stored in thestorage medium and perform correction of chromatic aberration ofmagnification on the color components of R and B in the second imagedata.
 2. The image processing apparatus according to claim 1, furthercomprising: a thinning unit configured to thin the color components of Rand B in the second image data such that resolution of the colorcomponents of R and B become lower than resolution of the luminancecomponent, and wherein the first storage unit stores the second imagedata whose color components of R and B are thinned by the thinning unitin the storage medium.
 3. The image processing apparatus according toclaim 2, wherein the thinning unit thins the color components of R and Bin the second image data half in a horizontal direction.
 4. The imageprocessing apparatus according to claim 2, wherein the correction unitcorrects the resolution of the color components of R and B in the secondimage data to the same resolution as the resolution of the luminancecomponent, and then performs the correction of chromatic aberration ofmagnification to the color components of R and B in the second imagedata.
 5. The image processing apparatus according to claim 1, whereinthe first conversion unit outputs the second image data in each of aplurality of frequency bands, and the correction unit performs thecorrection of chromatic aberration of magnification on the colorcomponents of R and B in the second image data in each of the pluralityof frequency bands.
 6. The image processing apparatus according to claim1, further comprising: a second conversion unit configured to convertthe first image data into third image data including color components ofR, G1, G2, and B; and a second storage unit configured to store thethird image data in the storage medium, wherein the correction unitswitches and performs a first mode for reading the second image datafrom the storage medium and performing the correction of chromaticaberration of magnification, and a second mode for reading the thirdimage data from the storage medium and performing the correction ofchromatic aberration of magnification.
 7. The image processing apparatusaccording to claim 6, wherein the correction unit switches and performsthe first mode and the second mode according to a requested processingspeed.
 8. The image processing apparatus according to claim 1, whereinthe array is a Bayer array.
 9. A method for processing an image, themethod comprising: converting first image data including an array ofcolor components of red (R), green (G1 and G2), and blue (B) into secondimage data including the color components of R and B and a luminancecomponent by performing false color suppression processing on the firstimage data separately using the color components of G1 and G2; storingthe second image data in a storage medium; and reading the second imagedata stored in the storage medium and performing correction of chromaticaberration of magnification to the color components of R and B in thesecond image data.